Least Squares Support Vector Machine Research Articles

Double decomposition with enhanced least-squares support vector machine to predict water level

Double decomposition with enhanced least-squares support vector machine to predict water level

Cutting-edge tool wear monitoring in AISI4140 steel hard turning using least square-support vector machine

ABSTRACT This research addresses the critical challenge of tool wear monitoring in AISI4140 steel hard turning through the innovative application of a Least Square-Support Vector Machine (LS-SVM) prediction model. While acknowledging the growing significance of hard turning over conventional grinding techniques, the background also recognizes the challenges posed by accelerated tool wear and decreased productivity. The main goal is to create a reliable tool wear prediction model that is tailored to harsh turning circumstances. Material selection, cutting force measurement, acceleration measurement, and accurate tool wear measurement are all included in the experimental procedures. Using time and frequency domain analyses, the research methodically examines how cutting force and acceleration affect tool wear. For feature selection, non-linear regression is used to determine which parameters have the greatest influence on wear. A comprehensive training and validation procedure, structural clarification, and a detailed mathematical foundation are used in the development of the LS-SVM-based tool wear prediction model. The presentation of the findings and related discussions explores the impact of acceleration and cutting force on wear. The LS-SVM model’s successful application for precise tool wear prediction in AISI4140 steel hard turning is highlighted in the conclusions, demonstrating the model’s potential to improve tool lifespan and manufacturing efficiency.

Intelligence modeling of the flow boiling heat transfer of nanorefrigerant for integrated energy system

To promote the application of nanorefrigerant in Organic Rankine Cycle and Integrated Energy System a reliable model with simple structure and favorable accuracy for predicting the flow boiling heat transfer coefficient (HTC) of nanorefrigerant is essential. In this work, four intelligence models—the radial basis function (RBF), multilayer perceptron (MLP), least squares support vector machine (LSSVM), and adaptive neuro fuzzy inference system (ANFIS)—were developed to predict the flow boiling heat transfer coefficient using nanorefrigerants, based on 765 experimental samples. The performances of these artificial intelligence models were comprehensively evaluated through accuracy analysis, variation trend analysis, and sensitivity analysis. Results indicated that the comprehensive performance of the RBF model was superior than those of other intelligence models and the existing empirical models. The RBF model accurately captured the variation trend of the output as the input variables were varied. Meanwhile, the impact degrees of all input variables in decreasing order were nanoparticle concentration (φ), mass flux (G), thermal conductivity of nanoparticle (kp), and vapor quality (x).

Comparing visible and near infrared ‘point’ spectroscopy and hyperspectral imaging techniques to visualize the variability of apple firmness

In this work, visible and near-infrared ‘point’ (Vis-NIR) spectroscopy and hyperspectral imaging (Vis-NIR-HSI) techniques were applied on three different apple cultivars to compare their firmness prediction performances based on a large intra-variability of individual fruit, and develop rapid and simple models to visualize the variability of apple firmness on three apple cultivars. Apples with high degree of intra-variability can strongly affect the prediction model performances. The apple firmness prediction accuracy can be improved based on the large intra-variability samples with the coefficient variation (CV) values over 10%. The least squares-support vector machine (LS-SVM) models based on Vis-NIR-HSI spectra had better performances for firmness prediction than that of Vis-NIR spectroscopy, with the with the Rc2 over 0.84. Finally, The Vis-NIR-HSI technique combined with least squares-support vector machine (LS-SVM) models were successfully applied to visualize the spatial the variability of apple firmness.

Apparent Resistivity Variation Imaging Method Based on Magnetic Field Gradient by NGO-LSSVM for the Ground-Airborne Frequency-Domain Electromagnetic Method

Apparent resistivity imaging is a typical rapid imaging method in the ground-airborne frequency-domain electromagnetic method. At present, the apparent resistivity is typically calculated by the measured magnetic field, however, this imaging method exhibits limited capability in recognizing the center of three-dimensional anomalies. Therefore, this paper proposed the calculation of apparent resistivity using magnetic field gradients. To solve the problem of random artificial anomalies that existed during the calculated process, this paper presents a hybrid least square support vector machine (LSSVM) and Northern Goshawk optimization (NGO) to establish the mapping relationship between the magnetic field gradient and apparent resistivity variation. This approach enables accurate prediction of apparent resistivity variations and effectively resolves the challenge of correcting background resistivity. Furthermore, three typical theoretical models and field examples are used to predict the apparent resistivity variation, the imaging results demonstrate that the proposed NGO-LSSVM algorithm is a feasible and efficient tool for predicting the apparent resistivity variation with high accuracy. This study provides a novel and efficient imaging method, which facilitates the application of ground-airborne frequency-domain electromagnetics for high-resolution detection requirements, such as mineral exploration.

Research on blasting vibration prediction based on BFO-LSSVM and its engineering application

In order to realize the accurate prediction of blasting vibration, the LS-SVM optimization model based on BFO algorithm is constructed with the help of bacterial foraging algorithm (BFO) and least squares support vector machine (LS-SVM) theory. 30 groups of blasting data are used as training samples to test the prediction accuracy of the model, and the main factors affecting the propagation of blasting vibration are selected as the input factors, such as single shot charge, blasting center distance, elevation difference, blockage, hole depth and other factors as the input factors, and blasting vibration as the output factor of the prediction model. The results show that the prediction accuracy of BFO-LSSVM model is higher than that of LS-SVM model under the same sample size. Taking the measured vibration data of excavation blasting of Wuqiangxi power station as an example, the average error of BFO-LSSVM model is 5.57%, which verifies the feasibility and practicability of the prediction model.

Online prediction of the enzymatic hydrolysis efficiency of crop straw

The extent of removal of lignin and hemicellulose are crucial indicators for evaluating the efficiency of enzymatic hydrolysis of crop straw. Numerous factors influence these two indices. Establishing a quantitative model that correlates these factors with hydrolysis efficiency is essential, as it can guide efficient hydrolysis. In this study, a predictive method for enzymatic hydrolysis efficiency in crop straw was proposed using Grey relational analysis (GRA), Kernel principal component analysis (KPCA), and a least squares support vector machine (LSSVM). The authors collected a dataset from actual production data and developed an efficiency predictive model using GRA for variable selection, KPCA for dimensionality reduction, and LSSVM for model training. This model allows for the direct estimation of the final enzymatic hydrolysis efficiency based on production condition variables, which can include enzyme amount, temperatures, pH, time, agitation, and straw dimensions. Extensive experimental testing validated the effectiveness of the proposed method, resulting in minimal errors, a high degree of fit, and exceptional performance. The methodology described in this study can serve as a foundation for optimising the design of efficient enzymatic hydrolysis production processes for crop straw. Additionally, it offers valuable soft measurements to support efficient control of the enzymatic hydrolysis process.

Quantitative measurement of internal quality of carrots using hyperspectral imaging and multivariate analysis

The study aimed to measure the carotenoid (Car) and pH contents of carrots using hyperspectral imaging. A total of 300 images were collected using a hyperspectral imaging system, covering 472 wavebands from 400 to 1000 nm. Regions of interest (ROIs) were defined to extract average spectra from the hyperspectral images (HIS). We developed two models: least squares support vector machine (LS-SVM) and partial least squares regression (PLSR) to establish a quantitative analysis between the pigment amounts and spectra. The spectra and pigment contents were predicted and correlated using these models. The selection of EWs for modeling was done using the Successive Projections Algorithm (SPA), regression coefficients (RC) from PLSR models, and LS-SVM. The results demonstrated that hyperspectral imaging could effectively evaluate the internal attributes of carrot cortex and xylem. Moreover, these models accurately predicted the Car and pH contents of the carrot parts. This study provides a valuable approach for variable selection and modeling in hyperspectral imaging studies of carrots.

A Hybrid Soft Sensor Model for Measuring the Oxygen Content in Boiler Flue Gas.

As an indispensable component of coal-fired power plants, boilers play a crucial role in converting water into high-pressure steam. The oxygen content in the flue gas is a crucial indicator, which indicates the state of combustion within the boiler. The oxygen content not only affects the thermal efficiency of the boiler and the energy utilization of the generator unit, but also has adverse impacts on the environment. Therefore, accurate measurement of the flue gas's oxygen content is of paramount importance in enhancing the energy utilization efficiency of coal-fired power plants and reducing the emissions of waste gas and pollutants. This study proposes a prediction model for the oxygen content in the flue gas that combines the whale optimization algorithm (WOA) and long short-term memory (LSTM) networks. Among them, the whale optimization algorithm (WOA) was used to optimize the learning rate, the number of hidden layers, and the regularization coefficients of the long short-term memory (LSTM). The data used in this study were obtained from a 350 MW power generation unit in a coal-fired power plant to validate the practicality and effectiveness of the proposed hybrid model. The simulation results demonstrated that the whale optimization algorithm-long short-term memory (WOA-LSTM) model achieved an MAE of 0.16493, an RMSE of 0.12712, an MAPE of 2.2254%, and an R2 value of 0.98664. The whale optimization algorithm-long short-term memory (WOA-LSTM) model demonstrated enhancements in accuracy compared with the least squares support vector machine (LSSVM), long short-term memory (LSTM), particle swarm optimization-least squares support vector machine (PSO-LSSVM), and particle swarm optimization-long short-term memory (PSO-LSTM), with improvements of 4.93%, 4.03%, 1.35%, and 0.49%, respectively. These results indicated that the proposed soft sensor model exhibited more accurate performance, which can meet practical requirements of coal-fired power plants.

Biochar-enhanced concrete mixes: Pioneering multi-objective optimization

The incorporation of biochar (BC) as a partial substitute for cement in concrete formulations provides a promising pathway for mitigating the environmental impacts associated with carbon dioxide emissions during cement production. To achieve optimal composition of BC-enhanced concrete, multiple objectives including mechanical strength, economic factors, and embodied CO2 must be balanced while considering a multitude of variables constrained by complex non-linear relationships. Here, we introduced an intelligent hybrid optimization algorithm that combines Particle Swarm Optimization (PSO), Least Squares Support Vector Machine (LSSVM), and Non-dominated Sorting Genetic Algorithm II (NSGAII) to predict the performance of BC-enhanced concrete and optimize its mix proportions for multiple objectives. Our results demonstrate that the PSO optimization algorithm for searching LSSVM hyper parameters outperforms other optimization algorithms, exhibiting higher generalization performance and improved overall accuracy (R2 = 0.95). Furthermore, the proposed model framework effectively presents a complete Pareto front for the BC-enhanced concrete mix ratio. This triangular model system for concrete mix ratio can determine the optimal solution, tailored to the preferences of the owner's unit. Ultimately, PSO-LSSVM-NSGAII intelligent hybrid optimization algorithm enhances the efficiency of mix proportion design for BC-enhanced concrete.

Sparse L0-norm least squares support vector machine with feature selection

Least squares support vector machine (LSSVM) is a powerful classification tool based on hyperplanes. But the classical LSSVM does not perform well on small sample size data sets (SSS) because it lacks feature selection capability. To address this issue, we introduce an L0-norm regularization term into the objective function of LSSVM, and propose a new sparse LSSVM model called L0-LSSVM. However, the introduction of the L0-norm makes the resulting optimization problem nonconvex and nonsmooth. To overcome these challenges, instead of using the traditional convex or non-convex approximation of the L0-norm, we design an efficient algorithm for L0-LSSVM based on alternating direction method of multipliers (ADMM) where the L0-norm is handled by employing the proximity operator. Numerical results demonstrate that L0-LSSVM not only exhibits excellent generalization performance and feature selection capability but also offers a substantial improvement in computational speed.

Crater-Spectrum Feature Fusion Method for Panax notoginseng Cadmium Detection Using Laser-Induced Breakdown Spectroscopy.

Panax notoginseng (P. notoginseng) is a valuable herbal medicine, as well as a dietary food supplement known for its satisfactory clinical efficacy in alleviating blood stasis, reducing swelling, and relieving pain. However, the ability of P. notoginseng to absorb and accumulate cadmium (Cd) poses a significant environmental pollution risk and potential health hazards to humans. In this study, we employed laser-induced breakdown spectroscopy (LIBS) for the rapid detection of Cd. It is important to note that signal uncertainty can impact the quantification performance of LIBS. Hence, we proposed the crater-spectrum feature fusion method, which comprises ablation crater morphology compensation and characteristic peak ratio correction (CPRC), to explore the feasibility of signal uncertainty reduction. The crater morphology compensation method, namely, adding variables using multiple linear regression (MLR) analysis, decreased the root-mean-square error of the prediction set (RMSEP) from 7.0233 μg/g to 5.4043 μg/g. The prediction results were achieved after CPRC pretreatment using the calibration curve model with an RMSEP of 3.4980 μg/g, a limit of detection of 1.92 μg/g, and a limit of quantification of 6.41 μg/g. The crater-spectrum feature fusion method reached the lowest RMSEP of 2.8556 μg/g, based on a least-squares support vector machine (LSSVM) model. The preliminary results suggest the effectiveness of the crater-spectrum feature fusion method for detecting Cd. Furthermore, this method has the potential to be extended to detect other toxic metals in addition to Cd, which significantly contributes to ensuring the quality and safety of agricultural production.

Estimating the natural gas compressibility factor using a statistical correlations and machine learning approaches

Gas compressibility factor plays an critical role in petroleum engineering applications such as gas metering, pipeline design, reserve estimation, gas flow rate, material balance calculations, and many other significant tasks. Therefore, it is crucial to accurately estimate the gas compressibility factor. There have been a lot of studies on calculating the gas compressibility factor from laboratory data, which can be summarized into two main approaches: statistical correlations and machine learning algorithms. In this study, on statistical correlations the authors implement explicit and implicit method while on machine learning algorithms, we use Artificial Neural Network (ANN) and Least-Squares Support Vector Machine (LS-SVM). The data was collected from open literature. Implementing the two approaches mentioned above and comparing statistical parameters such as Mean Squared Error (MSE), Root Mean Squared Error (RMSE), and Coefficient of Determination (R2 ) found that machine learning algorithms give much more accurate estimation results than statistical correlations, and besides, the ANN algorithm has the most accurate prediction results with the lowest MSE and RMSE (0.000002 and 0.0016) and the highest R2 (0.9999). The high-precision calculation results show that the ANN algorithm mentioned above can be applied to estimate other real gas compressibility factor data sets. On the other hand, this study can be extended to another subset of machine learning algorithms, such as deep learning and ensemble learning.

Study on detecting main ingredients of silicone rubber based on terahertz spectrum

AbstractThe authors investigated the ingredient detection technique of silicone rubber based on the Terahertz spectrum. For this purpose, 18 diverse high‐temperature vulcanised silicone rubber (HTVSR) formulations were customised, 8 of which are used as calibration set while the rest 10 as prediction set. Based on the Beer‐Lambert Law, the partial‐least‐square (PLS) regression model and the least‐squares support‐vector machines (LS‐SVM) regression model were used to yield the relationships between the absorption spectrums and the content percentages of polydimethylsiloxane (PDMS), alumina trihydrate (ATH), and silica in HTVSR. The results showed that for the formulations tested, the prediction accuracy of all three main ingredients by the PLS regression model could be improved by changing the spectrum range from 0.2–4 to 0.5–2 THz. If the data were pre‐processed by the Savitzky–Golay smoothing method or multiplicative scatter correction method, the prediction accuracy of PDMS could be further enhanced. However, this would lead to a slight decrease in the prediction accuracy of ATH. For the LS‐SVM regression model, the radial basis function (RBF) kernel and the linear kernel were studied. It was found that the prediction accuracy of both kernels was better than that of the PLS regression model. With the LS‐SVM regression model using the RBF kernel, the correlated coefficients of PDMS and ATH in the prediction set could be up to 0.9915 and 0.9742, respectively.

New insights into culvert scour depth calculation by soft computing models using multi-model ensemble approach and uncertainty analysis

ABSTRACT The accurate prediction of scour depth in culverts is crucial to ensure public safety and due to the uncertainties in classical empirical/deterministic equations, it remains challenging. This study presents new ensemble multi-models to predict scour depth and quantify model bias and uncertainty. In this study, culvert scour was predicted by gene expression programming (GEP) and least square support vector machine (LSSVM), firstly based on dimensionless parameters. In the multi-model ensemble strategy, four ensemble approaches, namely SM, WM, LSSVM, and BMA were applied. The LSSVM showed overall best skill for the multi-model approach, that reduced the error by 61.3% and increased the coefficient of determination by 52.1%. The results showed the proposed approach can satisfy the requirements of simplicity, applicability, and accuracy at the same time. For application purposes, we provided a simple code to obtain scour depth with great accuracy using LSSVM. BMA and LSSVM were used to quantify the scour culvert uncertainty. The results of the uncertainty analysis showed that the LSSVM predicts scour depth quite well and generates high-quality prediction intervals. The results revealed that a multi-model ensemble strategy improved accuracy, certainty and reliability for culvert scour compared to empirical equations.

Underwater Sound Speed Field Forecasting Based on the Least Square Support Vector Machine

Underwater sound speed is one of the most significant factors that affects high-accuracy underwater acoustic positioning and navigation. Due to its complex temporal variation, the forecasting of the underwater sound speed field (SSF) becomes a challenging task. Taking advantage of machine learning methods, we propose a new method for SSF forecasting based on the least square support vector machine (LSSVM) and a multi-parameter model, aiming to enhance the forecasting accuracy of underwater SSF with hourly resolution. We first use a matching extension method to standardize profile data and train the LSSVM with the parameters of observation time, temperature, salinity, and depth. We then employ radial basis function kernels to construct the forecasting model of SSF. We validate the feasibility and effectiveness of the LSSVM model by comparing it with the polynomial fitting (PF) and back propagation neural network (BPNN) methods, using hourly data obtained from the measured data and open data. The results show that the means of the root mean square for the LSSVM based on the observation time parameter and the LSSVM based on the multi-parameter model achieve 0.51 m/s and 0.45 m/s, respectively, presenting a significant improvement compared with the PF (0.82 m/s) and BPNN (0.76 m/s) methods.

Hybrid Metaheuristic Optimization Algorithms with Least-Squares Support Vector Machine and Boosted Regression Tree Models for Prediction of Air-Blast Due to Mine Blasting

Hybrid Metaheuristic Optimization Algorithms with Least-Squares Support Vector Machine and Boosted Regression Tree Models for Prediction of Air-Blast Due to Mine Blasting

Enhanced complex wire fault diagnosis via integration of time domain reflectometry and particle swarm optimization with least square support vector machine

AbstractUrban power systems rely on intricate wire networks, known as the power grid, which form the essential electric infrastructure in cities. While these networks transmit electricity from power plants to consumers, they are vulnerable to faults caused by manufacturing errors and improper installation, posing risks to system integrity. Thus, accurate identification and assessment of these faults are crucial to prevent damage and maintain system reliability. The objective of this research is to present an innovative and efficient methodology for diagnosing complex wire networks through the application of time domain reflectometry (TDR) combined with the particle swarm optimization (PSO) and least squares support vector machine (LSSVM) algorithm. This research addresses the imperative need to accurately locate and assess breakage faults within wire networks, emphasizing their role in both power transmission and communication infrastructure. To model the TDR answer of a specific complex wire network, a forward model is established utilizing resistance, inductance, capacitance and conductance (RLCG) parameters and the finite difference time domain (FDTD) method. Subsequently, the PSO‐LSSVM approach is used to solve the inverse problem of localizing faults in complex wire networks. The experimental results validate the practicality of this approach in real‐world systems.

Research on SPAD Estimation Model for Spring Wheat Booting Stage Based on Hyperspectral Analysis.

With the rapid progression of agricultural informatization technology, the methodologies of crop monitoring based on spectral technology are constantly upgraded. In order to carry out the efficient, precise and nondestructive detection of relative chlorophyll (SPAD) during the booting stage, we acquired hyperspectral reflectance data about spring wheat vertical distribution and adopted the fractional-order differential to transform the raw spectral data. After that, based on correlation analysis, fractional differential spectra and fractional differential spectral indices with strong correlation with SPAD were screened and fused. Then, the least-squares support vector machine (LSSSVM) and the least-squares support vector machine (SMA-LSSSVM) optimized on the slime mold algorithm were applied to construct the estimation models of SPAD, and the model accuracy was assessed to screen the optimal estimation models. The results showed that the 0.4 order fractional-order differential spectra had the highest correlation with SPAD, which was 9.3% higher than the maximum correlation coefficient of the original spectra; the constructed two-band differential spectral indices were more sensitive to SPAD than the single differential spectra, in which the correlation reached the highest level of 0.724. The SMA-LSSSVM model constructed based on the two-band fractional-order differential spectral indices was better than the single differential spectra and the integration of both, which realized the assessment of wheat SPAD.

Ultra-Wideband Ranging Error Mitigation with Novel Channel Impulse Response Feature Parameters and Two-Step Non-Line-of-Sight Identification.

The effective identification and mitigation of non-line-of-sight (NLOS) ranging errors are essential for achieving high-precision positioning and navigation with ultra-wideband (UWB) technology in harsh indoor environments. In this paper, an efficient UWB ranging-error mitigation strategy that uses novel channel impulse response parameters based on the results of a two-step NLOS identification, composed of a decision tree and feedforward neural network, is proposed to realize indoor locations. NLOS ranging errors are classified into three types, and corresponding mitigation strategies and recall mechanisms are developed, which are also extended to partial line-of-sight (LOS) errors. Extensive experiments involving three obstacles (humans, walls, and glass) and two sites show an average NLOS identification accuracy of 95.05%, with LOS/NLOS recall rates of 95.72%/94.15%. The mitigated LOS errors are reduced by 50.4%, while the average improvement in the accuracy of the three types of NLOS ranging errors is 61.8%, reaching up to 76.84%. Overall, this method achieves a reduction in LOS and NLOS ranging errors of 25.19% and 69.85%, respectively, resulting in a 54.46% enhancement in positioning accuracy. This performance surpasses that of state-of-the-art techniques, such as the convolutional neural network (CNN), long short-term memory-extended Kalman filter (LSTM-EKF), least-squares-support vector machine (LS-SVM), and k-nearest neighbor (K-NN) algorithms.